fix #538 - make /opt/spark/work-dir writable by gid 0 #560
fix #538 - make /opt/spark/work-dir writable by gid 0 #560erikerlandson wants to merge 1 commit intoapache-spark-on-k8s:branch-2.2-kubernetesfrom
Conversation
|
Note, altering the permissions of /opt/spark/work-dir appears to be sufficient, not all of $SPARK_HOME as I assumed originally when I wrote up #538 |
|
Tangentially, I fixed a missing |
erikerlandson
force-pushed
the
group-0-writable
branch
from
679a204 to
af70698
Compare
…e better in anonymous uid scenarios
erikerlandson
force-pushed
the
group-0-writable
branch
from
af70698 to
69f817d
Compare
|
@foxish ptal - also curious what you think about the missing |
|
Do we need this to go into the upstream as well? apache#19717 has the spark-base docker-file within the PR. |
|
I think for people looking to customize the image using ours as base, this might be an issue - to have the owner be root. I had a discussion on the thread with Mridul in apache#19717 (comment). Assuming that it'll be root might be tenuous when someone uses cc @liyinan926 |
2 participants
What changes were proposed in this pull request?
make /opt/spark/work-dir writable by gid 0 to operate better in anonymous uid scenarios
(Please fill in changes proposed in this fix)
How was this patch tested?
I'm using CI infra to fully test image creation and exercising via the unit/integration tests